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ABSTRACT 

In  this  paper  we  study  certain  fractional  factorial  designs, 
which  are  known  in  the  literature  as  incomplete  orthogonal  arrays. 
We  indicate  situations  in  which  these  designs  can  be  of  practical 
interest  and  study  their  statistical  properties. 


1.  INTRODUCTION 


The  problem  that  we  will  consider  in  this  paper  deals  with 
symmetrical  factorial  designs  based  on  k  factors  each  at  s 

k 

levels.  Potentially  there  are  s  possible  combinations  at 
which  observations  can  be  made  in  such  experiments.  In  many  prac¬ 
tical  situations  it  is  undesirable  to  make  this  many  observations. 
This  introduces  a  need  to  select  some  of  the  possible  combinations 
at  which  one  or  more  observations  should  be  obtained.  Such  ex¬ 
periments,  in  which  one  or  more  of  the  possible  combinations  are 
not  used,  are  known  as  fractional  factorial  experiments.  The 
choice  of  the  combinations  at  which  observations  are  to  be  made  is 
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a  difficult  problem.  There  are  statistical  considerations  (e.g., 
the  proposed  model,  the  experimenters  objective),  but  also  prac¬ 
tical  considerations  (e.g.,  financial  limitations,  time  considera¬ 
tions)  that  can  influence  this  choice.  In  a  series  of  three  papers 
Rao  (1946,  1947a,  1947b)  inspired  many  later  researchers  by  intro¬ 
ducing  and  studying  certain  fractions  with  many  desirable  statisti¬ 
cal  properties.  These  fractions  are  now  known  as  orthogonal  arrays 
A  formal  definition  will  be  given  in  Section  2.  For  the  current 
status  of  this  subject  we  refer  the  reader  to  Hedayat  and  Stufken 
(1986b) . 

The  inspiration  for  this  paper  is  that  there  are  practical 
situations  for  which  certain  specific  combinations  have  to  be  ex¬ 
cluded  from  experimentation.  For  example,  it  may  be  desirable 
that  combinations  in  which  2  or  more  factors  appear  at  certain 
levels  are  excluded.  Safety  considerations  or  financial  reasons 
are  potential  causes  for  such  a  restriction.  This  paper  studies 
certain  fractions  in  which  some  undesirable  combinations  do  not 
appear,  but  in  which  the  remaining  structure  is  such  that  under 
the  given  restriction  the  fractions  are  'as  close  as  possible' 
to  an  orthogonal  array. 

Example  1.1:  Suppose  we  are  considering  an  experiment  based  on  3 
factors,  each  at  4  levels  denoted  by  0,  1,  2  and  3.  It  may  be 
desirable  to  have  a  fraction  in  the  form  of  an  orthogonal  array  of 
strength  2,  except  that  due  to  practical  considerations  it  may  be 
undesirable  to  have  any  treatment  combination  in  which  more  than 
one  factor  appears  at  level  2  or  3.  A  viable  design  under  the 
given  restriction  is  exhibited  below. 
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The  combinations  to  be  used  in  the  experiment  are  given  as  the 


columns  of  this  array.  There  is  no  combination  in  which  two  fac¬ 
tors  appear  both  at  level  2  or  3.  But  other  than  that,  with  re¬ 
spect  to  any  two  factors  all  combinations  of  levels  that  we  did  not 
exclude  appear  exactly  once  in  these  columns.  This  is  an  example 
of  what  is  known  as  an  incomplete  orthogonal  array. 

We  would  like  to  point  out  that  in  the  above  example  the  design 
can  be  completed  to  an  orthogonal  array  by  adding  the  following 
four  (undesirable)  combinations: 

2  2  3  3 
2  3  2  3 
2  3  3  2 

Although  the  name  'incomplete  orthogonal  array'  may  give  rise  to 
the  idea  that  it  can  always  be  completed  to  an  orthogonal  array 
(without  increasing  the  frequency  of  level  combinations  that  were 
not  excluded),  this  is  not  the  case.  There  are  two  reasons  why  it 
may  not  be  possible  to  do  this.  It  is  possible  that  an  orthogonal 
array  with  the  required  parameters  does  not  exist,  but  it  may  also 
be  that  the  structure  of  the  incomplete  orthogonal  array  does  not 
permit  such  a  completion  even  though  an  orthogonal  array  with  the 
desired  parameters  does  exist.  For  more  details  we  refer  to 
Hedayat  and  Stufken  (1986a) . 

In  Section  2  we  will  formally  introduce  incomplete  orthogonal 
arrays.  In  Section  3  we  will  study  some  of  the  statistical  aspects 
of  these  arrays.  Section  4  will  give  a  brief  discussion  of  possi¬ 
ble  future  research  projects  in  this  subject.  For  the  mathematical 
properties  of  incomplete  orthogonal  arrays  we  refer  the  reader  to 
Horton  (1974),  Maurin  (1985)  and  Hedayat  and  Stufken  (1986a). 


2.  DEFINITIONS  AND  NOTATIONS 


In  this  section  we  will  give  a  formal  definition  of  an  incom¬ 
plete  orthogonal  array.  Throughout  the  paper  S  will  denote  a  set 
of  s  symbols,  while  H  will  be  a  subset  of  S  of  cardinality  h. 

Definition  2.1:  A  k  *  N  array  based  on  S  is  called  an  incom¬ 

plete  orthogonal  array  based  on  S  and  H  and  of  strength  t  if 
the  columns  of  any  t  *  N  subarray  contain  each  element  from 
St  -  HC  equally  often,  say  X  times,  while  those  from  HC  do 
not  appear  at  all. 

An  immediate  consequence  of  the  definition  is  that  the  equality 
N  =  X(st-ht)  must  hold.  The  integer  X  is  also  called  the  index 
of  the  array.  We  will  denote  these  arrays  by  IOA(N,k, (s,h) ,t) . 

For  comparison  we  recall  the  definition  of  an  orthogonal  array. 

Definition  2.2:  A  k  *  N  array  based  on  S  is  called  an  ortho¬ 

gonal  array  of  strength  t  if  the  columns  of  any  t  *  N  subarray 
contain  each  element  of  SC  equally  often,  say  X  times. 

Here  we  see  immediately  that  N  »  XsC.  We  denote  these  arrays 
by  OA(N,k,s,t). 

As  in  the  study  of  orthogonal  arrays,  an  interesting  question 
is  to  find  the  largest  value  of  k  for  which  an  IOA(N,k, (s ,h) ,t) 
exists,  for  given  N,s,h  and  t.  Hedayat  and  Stufken  (1986a) 
showed  that  the  inequality 

k  s  s/h  +  t  -  1 

must  always  be  satisfied. 

We  would  like  to  point  out  that  incomplete  orthogonal  arrays 
are  a  heavily  structured  type  of  balanced  arrays.  The  latter 
arrays  were  introduced  by  Chakravarti  (1956)  and  many  interesting 
results  on  it  were  obtained  by  Srivastava  (1972)  and  Rafter  and 
Seiden  (1974).  Srivastava  and  her  co-workers,  as  well  as  several 
Japanese  statisticians,  have  made  valuable  contributions  to  the 
area  of  balanced  arrays. 


It  is  easy  to  show  that  an  orthogonal  array  of  strength  t  is 

also  of  strength  t'  <  t.  However  for  incomplete  orthogonal  arrays 

such  a  property  does  no  longer  hold.  In  any  t'  rows  of  an 

IOA(A(sC  -  hC) ,k, (s ,h) ,t) ,  t  2  t',  it  can  easily  be  shown  that  any 
t  *  t~t  *  t  "“t  1 

t'-tuple  from  H  appears  A(s  -h  )  times,  while  those 
t  *  t  *  t““t  * 

from  S  -H  appear  Xs  times  each.  The  array  is  thus 

still  a  heavily  structured  balanced  array  of  strength  t',  but  with 
our  definition  of  an  incomplete  orthogonal  array  there  is  for  any 
array  at  most  one  strength  for  which  the  requirements  in  the  defi¬ 
nition  are  satisfied. 

3.  STATISTICAL  ASPECTS  OF  INCOMPLETE  ORTHOGONAL  ARRAYS 

In  this  section  we  will  prove  a  general  result  on  the  use  of 
incomplete  orthogonal  arrays  of  strength  2  as  fractional  factor¬ 
ial  designs  under  the  orthogonal  polynomial  model.  We  will  illu¬ 
strate  this  result  with  two  detailed  examples.  We  will  assume 
that  the  reader  is  familiar  with  the  standard  terminology  for  fac¬ 
torial  designs.  If  not,  a  useful  reference  is  Rak toe,  Hedayat  and 
Federer  (1981). 

Suppose  that  under  the  orthogonal  polynomial  model  in  a  symme¬ 
trical  factorial  design  we  can  neglect  all  the  interaction  effects. 
It  is  well  known  that  if  a  fractional  factorial  design  in  the  form 
of  an  orthogonal  array  of  strength  2  is  used,  the  general  mean  and 
all  main  effects  are  (orthogonally)  estimable.  The  following 
theorem  gives  a  comparable  result  for  incomplete  orthogonal  arrays. 

2  2 

Theorem  3.1:  If  we  use  an  IOA(A(s  -h  ),k,(s,h),2)  as  a  fractional 
factorial  design  under  the  orthogonal  polynomial  model  and  under 
the  assumption  that  the  only  non-zero  factorial  effects  are  the 
general  mean  and  the  main  effects,  then 

(i)  if  k  <  s/h  +  1  all  effects  are  estimable: 


(ii)  if  k  =  s/h  +1  we  add  one  more  run  in  which 
all  factors  are  at  one  of  the  h  levels  of  H 
and  reach  then  the  same  conclusion  as  in  (i). 

(Recall  from  Section  2  that  k  £  s/h  +  1.) 

Proof:  Let  A^  be  the  incomplete  orthogonal  array  based  on  S  and 

H  as  in  the  statement  of  the  Theorem.  Let  be  the  fractional 

k  k  £ 

factorial  design  with  all  h  runs  from  H  .  Let  A  be  the  juxta¬ 
position  of  A^  and  If  we  now  let  X,  X1  and  X2  be  the 

design  matrices  corresponding  to  A,  A^  and  A^  respectively, 
under  the  model  as  described  in  the  Theorem,  then  we  can  write 


Our  first  claim  is  that  X  is  of  full  column  rank,  i.e., 

r(X)  =  k(s-l)  +1.  An  easy  way  to  see  this  is  as  follows:  look  at 
*  k-2 

A  ,  the  juxtaposition  of  h  replications  of  A  and  A  re- 

a 

plications  of  A  .  Then  A  is  an  orthogonal  array  of  strength  2, 

^  it 

implying  that  its  design  matrix  X  under  the  above  model  is  of 

* 

rank  k(s-l)+l.  But  the  rows  in  X  are  just  replications  of  the 
rows  in  X.  Hence  r(X)  *  r(X*)  which  shows  the  claim.  We  would 
like  to  show  that  r (X^  =  k(s-l)  +  1 .  For  this  now  it  suffices  to 
show  that  the  row  space  of  X2  is  a  subspace  of  the  row  space  of 
X^  Choose  an  arbitrary  row  in  ,  say  r,  which  corresponds  to 
a  treatment  combination,  say  (a^,...,a^),  in  which  all  levels  are 
from  H.  In  A^  there  are  A(s-h)  runs  in  which  the  itn  factor 
is  at  level  With  u  *  A(s-h)  we  denote  the  corresponding  rows 

in  Xn  by  r|*\...,r^,  1  <  i  <  k.  The  number  of  runs  in  A  in 
x  a  u  22  1 

which  no  factor  is  at  a  level  from  H  equals  A(s  -h  )  -  Akh(s-h)  = 

*  A(s-h) (s+h-kh) .  If  we  denote  this  number  by  v  then  v  >  0  if 

and  only  if  k  <  s/h  +  1.  Assuming  that  this  holds  let  rj,...,r  be 

the  rows  in  X^  corresponding  to  these  runs.  We  claim  now  that 


Notice  that  this  claim  would  establish  (i),  since  the  arbitrarily 
selected  row  r  from  is  expressed  as  a  linear  combination  of 

rows  in  X  . 

Let  M  =  (m^.),  0  <  i,  j  <  s-1  be  the  orthogonalized  matrix 
corresponding  to  a  one-factor  orthogonal  polynomial  model.  The 
entry  in  X  corresponding  to  a  run  (6^,..., 8^)  and  an  effect 


>0  J*° 

*1 


,l<8.<k,0<j<s-l  is  given  by 


m  .  (This  is  under  the  assumption  that  M  is  not  normalized 

P  Q  J 

ana  that  its  first  coluran  is  .  If  M  is  normalized 

we  would  have  to  add  everywhere  a  constant  term,  but  other  than 
that  the  proof  can  be  continued  unchanged.  See  also  Hedayat  and 
Stufken  (1986a)). 

In  the  runs  corresponding  to  the  rows  in  the  left  hand  side 

of  (3.1)  factor  i  is  u  times  at  level  a„  and  A(k-l)  times 

* 

at  level  y  for  any  y  e  S  -  H.  Hence  the  coordinate  of  the  left 
hand  side  in  (3.1)  corresponding  to  the  effect 

«i°  •••  *lA*h  -  equals 


(3.2) 


urn  .  +  >.  (k-1)  E  m 
'V  yeS-H 


In  the  runs  corresponding  to  r^,...,rv  factor  l  is  >. (s+h-hk) 
times  at  level  y  e  S-H.  In  the  run  corresponding  to  r  factor 
l  is  at  level  a  .  Hence  the  coordinate  of  the  right  hand  side 
in  (3.1)  corresponding  to  the  above  effect  equals 


(3.3) 


um  .  +  (k-"1—  X  (s+h-hk)  E  m 
V  v  yeS-H  VJ 


It  is  clear  that  (3.2)  and  (3.3)  are  the  same,  which  establishes 
(3.1)  and  thus  (i). 


For  (ii)  the  problem  Is  that  v  =  0,  and  every  run  In  con¬ 

tains  exactly  one  element  from  H.  However  choosing  an  arbitrary 
row  r  from  X0  and  defining  the  rows  r^  as  above  we  obtain 


that  the  coordinate  of 


j 


k  U  (i) 

I  I  r)  }  -  ur 

i=l  j=l  J 


corresponding  to  the  same  factorial  effect  as  above  equals 


A(k-l) 


£ 

yeS-H 


m  .  . 


Y3 


Since  this  does  not  depend  on  r  we  see  that  if  we  add  one  row 
from  to  X^  all  other  rows  from  can  be  obtained  as  a 

linear  combination  of  the  selected  row  in  and  the  rows  in  X  . 

That  shows  (ii)  and  concludes  the  proof  of  Theorem  3.1  □ 


We  will  now  give  two  examples,  the  first  of  which  relates  to 
the  situation  in  Theorem  3.1  (ii) ,  the  second  to  part  (i)  of  that 
theorem. 

Example  3.1:  Let  s  =  4,h=2,  k=3.  Indeed  k  =  s/h  +  1.  Con¬ 
sider  the  incomplete  orthogonal  array  from  Section  1.: 
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The  design  matrix  for  this  fractional  factorial  design  under 

the  model  in  Theorem  3.1  is  given  below.  For  its  computation  we 
used  the  matrix  M  given  by 


M  = 


1-3  1-1 

1-1-1  3 

1  1-1-3 

1  3  1  1_ 


We  obtained: 


rn* r-' ^  »?  >  v  ■” ■  * "■  ■  •"  ■  - ■•  r-r 


x,  = 


0 

0 

2 

1 

-3 

1 

-1 

-3 

1 

-1 
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-1 

-3 

0 

1 

3 

1 

-3 
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-1 

-1 

-1 

3 

3 

1 

1 

0 

2 

1 

1 

-3 

1 

-1 

1 

-1 

-3 

-1 

-1 

3 

0 

3 
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-1 

3 

1 
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-3 

1 

-1 
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-1 

-1 
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-3 
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-1 
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-1 
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-1 

-1 
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-1 

-3 

-3 
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-1 
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-1 

-1 
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-1 
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-1 

-1 

3 

2 

1 
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1 
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-1 

-3 

-1 

-1 

3 

-3 

1 

-1 

3 

0 

0 

1 

3 

1 

1 

-3 

1 

-1 

-3 

1 

1 

—  X 

3 

1 

1 

1 

3 

1 

1 

-1 

-1 

3 

-1 

-1 

3 

The  columns  of 
ing  factorial  effects: 


correspond.  In  the  given  order,  to  the  follow- 


.0.0,0  .1.0,0 

^1/ 2*3 *  *1/2^3  * 


.2.0,0 

'  1T2 ' 3 ’ 


3  0  0 

k  +  A 

'  1 '2  v3 ’ 


0  10 

*  ■‘■A  ...  A 

*1*2*3’  '1*23’ 


02  0  0  3  0 


lv2’3  ’ 


A0,0,1 

*  1*2  ^3  ’ 


0  0  2 
*1*2*3’ 


0  0  3 
tl*2°3‘ 


That  this  matrix  is  not  of  full  column  rank  becomes  clear  if  we  look 
at  the  information  matrix  XjX^  This  matrix  is  displayed  below. 
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-8 
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4 

-8 

0 

4 

-8 

0 

4 

-8 

60 

-4 

0 

-16 

0 

8 

-16 

0 

8 

0 

-4 

12 

-8 
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0 

0 

0 

0 

0 

4 

0 

-8 

60 

8 

0 

-4 

8 

0 

-4 

-8 

-16 

0 

8 

60 

-4 

0 

-16 

0 

8 

0 

0 

0 

0 

-4 

12 

-8 

0 

0 

0 

4 

8 

0 

-4 

0 

-8 

60 

8 

0 

-4 

-8 

-16 

0 

8 

-16 

0 

8 

60 

-4 

o 

0 

0 

0 

0 

0 
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0 

-4 

12 

-8 

4 

8 

0 

-4 

8 

0 

-4 

0 

-8 

60  J 

It  is  easy  to  verify  that  the  vector  (5 ,2 ,0 ,-l ,2 ,0,-1 ,2  ,0,-1)  ’ 
is  in  the  null  space  of  this  matrix. 


If  we  add  one  more  run  to  our  fractional  factorial  design,  a 
run  in  which  each  factor  appears  at  a  level  from  H  =  {2,3}  the 
new  design  matrix,  say  X,  is  of  full  column  rank.  As  an  example, 
suppose  we  add  the  run  (2,2,2).  This  corresponds  to  adding  the 


row  vector 


(1, 1,-1, -3,1. -1,-3, 1,-1, -3) 


X’K  = 


(X'X) 


-1 


ious  design  matrix.  Computing  X'X 

gives 
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-7  -1 

1 

-7  -1 

1  -7 

-1 

1 

-7 

61  -5 

-3 

-15  -1 

5  -15 

-1 

5 

-1 

-5  13 

-5 

-1  1 

3  -1 

1 

3 

1 

-3  -5 

69 

5  3 

5  5 

3 

5 

-7  - 

15  -1 

5 

61  -5 

-3  -15 

-1 

5 

-1 

-1  1 

3 

-5  13 

-5  -1 

1 

3 

1 

5  3 

5 

-3  -5 

69  5 

3 

5 

-7  - 

15  -1 

5 

-15  -1 

5  61 

-5 

-3 

-1 

-1  1 

3 

-1  1 

3  -5 

13 

-5 

1 

5  3 

5 

5  3 

5  -3 

-5 

69 

is  of  full  rank, 

and  its  inverse  is 

given  by: 

125 

35 

25  -5  35 

25  -5 

35 

25 

-5  ~ 

35 

27 

15  -1  16 

10  -3 

16 

10 

-3 

25 

15 

75  5  10 

0  -5 

10 

0 

-5 

1 

-5 

-1 

5  13  -3 

-5  -1 

-3 

-5 

-1 

800 

35 

16 

10  -3  27 

15  -1 

16 

10 

-3 

25 

10 

0  -5  15 

75  5 

10 

0 

-5 

-5 

-3 

-5  -1  -1 

5  13 

-3 

-5 

-1 

35 

16 

10  -3  16 

10  -3 

27 

15 

-1 

25 

10 

0  -5  10 

0  -5 

15 

75 

5 

-5 

-3 

-5  -1  -3 

-5  -1 

-1 

5 

13 

Example  3.2:  Let  s  =  4,  h  =  2  and  k  =  2.  Thus  k  <  s/h  +  1. 
Consider  the  following  incomplete  orthogonal  array: 


000011112233 

012301230101 

We  will  in  this  example,  since  we  will  not  only  be  interested  in 
the  rank  of  the  design  matrix  but  will  give  some  more  detailed 
computations,  use  the  normalized  form  of  M,  i.e., 


-10- 


2 

2/1 

2 

2/5 

1 

1 

1 

-3 

2 

2/5 

2 

2/5 

1 

3 

1 

1 

The  design  matrix  X1  under  the  model  in  Theorem  3.1  and  the 
information  matrix  XjX^  as  we^  as  *ts  ^nverse  (X|X^)  a 
displayed  below. 


40  X, 


-3  /5 

-3  /5 

-3  /5 

-3  /5 

-1  -/5 


-3  /5 

-1  -/5 


00  10  20  3,0  01  02 

The  columns  correspond  to  ^^^2*  ^1^2’  ^1^2*  ^1^2’  ^1^2’  ^1^2 

in  that  order. 


I 


It  is  now  a  simple  exercise  to  compute  the  BLUE  of  each  of  the 

factorial  effects.  These  are  given  below,  with  Y  referring 

ap 

to  the  observation  under  run  (a, 6). 


A 

>1*2  -  f<Y02  +  Y03  +  Y12  +  Y13  +  Y20  +  Y21  +  ?30  +  Y31> 


A 

.1.0  -  -±- 

p,  - 

1  2  4^ 


('5Y00  "  5Y01  "  Y02  “  Y03  “  3Y10  3Y11  +  Y12 

+  Y13  +  2Y20  +  2Y21  +  6Y30  +  6Y31) 


*1*2  =  4(Y00  +  Y01  +  Y02  +  Y03  “  Y10  ~  Y11  ~  Y12  '  Y13  ”  2Y 


20 


m 

r 


•vv, 


-  2Y  +  2Y  +  2Y  ) 


4.  CONCLUDING  REMARKS 


In  the  previous  sections  we  indicated  situations  for  which  the 
use  of  incomplete  orthogonal  arrays  as  fractional  factorial  designs 
might  be  considered  and  gave  a  useful  statistical  property  for  such 
arrays  of  strength  2.  However,  we  are  well  aware  that  many  inte¬ 
resting  questions  remain  unsolved.  A  study  of  the  statistical 
properties  of  incomplete  orthogonal  arrays  of  arbitrary  strength 
t  would  certainly  be  welcome.  The  available  results  in  the  litera¬ 
ture  on  the  construction  of  these  arrays  are  also  rather  meager. 

It  would  also  be  nice  if  we  could  replace  the  added  treatment  com¬ 
bination  in  Theorem  3.1  (ii)  by  one  in  which  at  most  one  factor 
appears  at  a  level  from  H.  We  do  not  know  whether  this  can  be 
achieved  or  not. 
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